🕷️️ Job Radar • SCRAPING

freelancer.com 🟡 2026-05-09

🔹 Refactor raw job descriptions into a structured Technical Manifest (JSON)
👤 Client: 🇴🇲 Muscat, Oman Member since 2017-09-10
💰 Price: $473 Average bid
🚩 Problem: Extract product details from an Oman-based e-commerce website and structure the data in a JSON format.
📦 Existing: Not specified

Specifications:

[Target] Extract product information from an e-commerce site with JavaScript-rendered content.
[Method] Use Playwright for web scraping due to JavaScript rendering.
[UI/UX] Not applicable as this is a backend task.
[Stack] Python, Playwright, openpyxl, JSON.
[Security] Ensure data privacy and handle rate limiting gracefully.
[Format] Output structured JSON with product details.

Workflow:

Install necessary libraries: Playwright, openpyxl.
Set up Playwright to navigate the website and extract required information.
Implement random delays between requests (2-5 seconds minimum).
Extract data in a structured manner including category hierarchy, SKU, product name, price, description, and ingredients.
Save output incrementally to JSON files for checkpointing and resuming.
Create a CONFIG block for easy settings adjustment.
Handle pagination across all category pages.